JNS 

JOURNAL OF NUTRITIONAL SCIENCE 



HUMAN AND CLINICAL NUTRITION 

Evaluations of Actiheart, IDEEA® and RT3 monitors for estimating activity 
energy expenditure in free-living women 

Marie Lof^'^*, Hanna Henriksson^'^ and Elisabet Forsum^ 

^Department of Clinical and Experimental Medicine, ¥ acuity of Health Science, Unkoping University, Unkbping Sweden 
'^Department of Biosciences and Nutrition, Kurolinska Institutet, Stockholm, Sweden 

(Receiped 5 December 201 2 — Final revision received 25 April 201 3 — Accepled 7 June 201 3) 

Journal of Nutritional Science (2013), vol. 2, e31, page 1 of 10 doi:10.1017/jns.2013.18 
Abstract 

Activity energj' expenditure (AEE) during free-living conditions can be assessed using devices based on different principles. To make proper comparisons 
of different devices' capacities to assess AEE, they should be evaluated in the same population. Tlius, in the present study we evaluated, in the same group 
of subjects, the ability of three devices to assess AEE in groups and individuals during free-living conditions. In twent)^ women, AEE was assessed using 
RT3 (three-axial accelerometry) (AEErts), Actiheart (a combination of heart rate and accelerometry) (AEE/^j.^) and IDEEA (a multi-accelerometer system) 
(AEEjoeea). Reference AEE (AEE„f) was assessed using the doubly labelled water method and indirect calorimetry. Average AEEacb was 5760 icj per 24 
h and not significandy different from AEE„f (5020 kj per 24 h). On average, AEErt3 and AEEjdeea were 2010 and 1750 kj per 24 h lower than AEEjef, 
respectively (P< 0-001). The limits of agreement (± 2 so) were 2940 (Actiheart), 1820 (RT3) and 2650 (IDEEA) kJ per 24 h. The variance for AEErt.i was 
lower than for AEEy^^.^ (P = 0-006). The RT3 classified 60 % of the women in the correct activity' category while the corresponding value for IDEEA and 
Actiheart was 30 '/o. In conclusion, the Actiheart may be useful for groups and the RT3 for individuals while the IDEEA requires further development. 
The results are likely to be relevant for a large proportion of Western women of reproductive age and demonstrate that the procedure selected to assess 
physical activity can gready influence the possibilities to uncover important aspects regarding interactions between physical activity, diet and health. 
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During recent decades lifest^'le-related health problems have 
become common worldwide, important reasons being poor 
dietar}' habits with a high intake of energ}' and lack of physical 
activity*-^ The beneficial effects of physical activity' on 
human health are due, to a large extent, to its ability to increase 
energy metabolism. Furthermore, physical activity is defined as 
muscular activity that increases energ}' expenditure'-'*''. 
Therefore, procedures to assess physical activitjr should be 
evaluated using methods able to measure energ}' expenditure 



in response to physical activit}'. This can be achieved by 
using the doubly labelled water method to assess total energy 
expenditure (TEE) during free-living conditions and indirect 
calorimetry to assess BMR, a combination referred to as 'refer- 
ence methods' in the following. This approach makes it poss- 
ible to calculate activity' energ}' expenditure (AEE) as TEE 
minus BMR and provides the average amount of energy 
expended in response to physical activity during the 
study period. 



Abbreviations: AEE, activity energ)' expenditure; AEEsdresuit, total energy expenditure, measured using the doubly labelled water method during days 1—5 minus BMR 
measured using indirect calorimetry; AEEacu, activity energ)^ expenditure assessed using Actiheart; AEEiqeea, activity energj^ expenditure assessed using IDEEA; AEE^ef, 
activity energj' expenditure assessed using the doubly labelled water method and indirect calorimetr}'; AEErx3, activity^ energy expenditure assessed using RT3; CountSActi, 
counts using Actiheart; CountSiDEEA, counts using IDEEA; CountSRT3, counts using RT.^; DIT, dietar)' induced thermogenesis; HRaR, heart rate above resting heart rate; 
MET, metabolic equivalent; TEE, total energy expenditure; TEEgj^^j^^jjp TEE during days 1—5; TEEjQppy^, total energ\' expenditure measured using IDEEA; TEE^^f, total 
energy expenditure measured using the doubly labelled water method. 
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Questionnaires may be used to assess physical activity 
since they are comparatively cheap and easy to use but are 
influenced by subjective factors such as the capacit}' of individ- 
uals to report their activity accurately. NeUson et al}-^^ reviewed 
studies evaluating such questionnaires and found that their val- 
iditjr often was poor at the group as well as at the individual 
level. Thus, there is a need for objective methods to assess 
physical activity. Currendy used methods of this kind are 
based on different principles, for example, heart rate monitor- 
ing, an old and well-established technique'''''', movement regis- 
tration, or combinations of these principles'^''. Such a 
combination is used in the Actiheart monitor (CamNtech 
Ltd), which has been applied in studies to assess AEE in preg- 
nant''^-' and obese''"'''"'' subjects. Actiheart is used in several 
on-going cohort studies investigating variations in physical 
activity between individuals in relation to health'-' Monitors 
recording body movements in one axis were developed several 
years ago and later monitors recording body movements in 
several axes became available. There are a number of such 
monitors^'^'', for example, the RT3 (Stayhealthy Inc.), a 
three-axial accelerometer. A different kind of movement regis- 
tration is used by the IDEEA*® (Intelligent Device for Energy 
Expenditure and Physical Activity'; MiniSun LLC) device. This 
system identifies the amount of time spent in different activi- 
ties using sensors attached to different parts of the body^^ "'''''•'. 
This principle is interesting since it is different from principles 
used in other accelerometers. The potential of this system may 
be considerable but its vaUdit}' is insufficiendy known and it 
may need further development before it can be applied in 
studies. 

There are a large number of studies reporting the potential 
of different devices to assess physical activity as evaluated by 
means of reference methods '■'^^^"''. In a review from 2007, 
Plasqui & Westerterp^'^-' concluded that three-axial acceler- 
ometers produced more accurate results than did those 
recording movements in one dimension only, while the great 
variability in the vaMdit}' of different accelerometers to assess 
physical activity is emphasised in a more recent review by 
Plasqui et al}-^~\ Another review by Van Remoortel ef alS^'^^ 
found evidence indicating that tri-axial accelerometers as 
well as multisensorjr monitors (including the Actiheart and 
the IDEEA) tend to be superior to uniaxial accelerometers^'^''. 
However, the conclusions from these re'views'''^''^'''''' are 
based on comparisons of data obtained in many groups of 
subjects differing considerably with respect to factors such 
as age, sex, body composition, health status and pattern of 
physical activit}'. It is verjr likely that the performance of moni- 
tors is influenced by such factors and therefore it is necessary 
to compare the capacity of uniaxial and tri-axial acceler- 
ometers to assess physical activity simultaneously in the 
same group of subjects. Such a comparison has been per- 
formed for Actiheart and RT3 in lean and obese men^^'-'. 
The results indicated that Actiheart was superior to RT3. In 
the present paper we use reference methods to evaluate the 
capacit}' of three different devices, the Actiheart, the 
IDEEA and the RT3, to assess AEE during free-living con- 
ditions. The devices were evaluated simultaneously in one 
group of healthy women. 



Subjects and methods 

Comments on design 

Actiheart and RT3 provide estimates of AEE while IDEEA 
estimates TEE. The manufacturer of the IDEEA provided 
guidance regarding how to calculate AEE from the TEE 
values produced by the monitor. Therefore AEE was con- 
sidered to be the appropriate estimate in the present study. 
However, reference methods can only produce estimates of 
AEE -with the so-called dietar}' induced thermogenesis (DIT) 
included. In current evaluations of devices intended to assess 
energy expenditure in response to physical activity it is com- 
mon to calculate AEE as 0-9 x TEE minus BMR, thus assum- 
ing that DIT represents 10 % of TEE. Therefore, it was 
important to determine if the estimates of AEE produced 
by the monitors included DIT. For reasons given below, we 
decided to compare AEE, as obtained with the three moni- 
tors, with TEE minus BMR with no deduction for DIT. 
Furthermore, unfortunately, the manufacturers of all three 
monitors provided only incomplete information regarding 
data acquisition and processing. Therefore we were careful 
to foUow the recommended procedures and all questions we 
had during the study were resolved after discussion with a 
commercial representative. 

Study outline 

Each woman collected two to three urine samples at home and 
brought them to the measurement session at the hospital, 
which started with a measurement of BMR. The woman's 
heart rate was measured during the BMR measurement by 
means of the Actiheart. Subsequendy, after a standardised 
breakfast (42 kj/kg fat- free mass and 15 % of total energy 
from protein), the woman performed seven standardised 
activities -with the Actiheart attached to her body. Her energy 
expenditure was measured simultaneously using indirect calori- 
metry to establish equations producing estimates of AEE 
appropriate for each individual woman as requested when 
the Actiheart is applied. Details of this procedure are given 
below. The woman was then given a dose of doubly labelled 
water, and asked to collect six urine samples during the sub- 
sequent 14 d (days 1—15) to measure her TEE during days 
1-5 (TEEsjresuit) as well as during days 1—14 (TEE^jf). The 
urine samples were to be taken in the morning on days 1, 4, 
6, 8, 11 and 15 and the woman was asked to carefully note 
the time of sampling. Before leaving the hospital the three 
monitors were attached to the woman's body and she was 
asked to wear the Actiheart and RT3 until day 15 and the 
IDEEA until day 6. The purpose was to record counts 
(CountSAcri), heart rate and AEE (AEEActi) by means of the 
Actiheart; counts (CountSmEEA) and AEE (AEEjoeea) by 
means of the IDEEA; and counts (CountSRTs) and AEE 
(AEEaxs) by means of the RT3. The woman was instructed 
that she should always wear the monitors, except when in 
water or sleeping, and to record in a notebook when they 
were taken off, as well as the activities then performed (for 
example, showering or sleeping). She was also instructed to 
attach all monitors at the same time in the morning and to 



remove them simultaneously just before going to bed. After 
the 14 d period the women returned to the hospital to deliver 
urine samples, monitors and the notebook. The present study 
was conducted according to the guidelines laid down in the 
Declaration of Helsinki and all procedures involving human 
subjects were approved by the Central Ethical Review 
Board, Stockholm, Sweden. Verbal informed consent, wit- 
nessed and formally recorded, was obtained from all women. 

Sample size and subjects 

The initial evaluation of the monitors was conducted by means 
of the Bland— Altman procedure''^^^ which has the capacity to 
provide descriptive and relevant information of different 
methods. The original description of this procedure is based 
on one example with seventeen observations''^^'. The infor- 
mation thus obtained may motivate subsequent evaluations 
including testing of specific hjipothesis. When planning the 
present study we wanted to identify differences in average 
AEE values related to a possible practical application of the 
monitors. We also considered available information regarding 
the principles used by the monitors to record physical activity. 
In particular we considered the need to assess energy expendi- 
ture to validate energy intake in dietary studies since under- 
reporting is a common problem in such studies''^'^''. For this 
application valid estimates of TEE at the group level are 
important and therefore a possibUit}' to obtain valid estimates 
of AEE would be of value. Such estimates of AEE could then 
be added to BMR to obtain TEE which should be equal to the 
energy intake and therefore useful when evaluating dietary 
energjr intake data. We considered that BMR can be measured 
without any average bias and that a bias in AEE of less than 
15 % would be acceptable. This represents a bias of less than 
approximately 7 % in TEE since AEE is less than 50 % of 
TEE. In this context it may be of interest to note that 
NeUson et alF^ considered that a bias of 10 % in TEE rep- 
resented acceptable criterion validity when evaluating physical 
activity questionnaires. We also considered that AEEaco could 
be expected to be identical to AEE^^f at the group level since a 
calibration, bringing the output in agreement with physiologi- 
cal values, is included when Actiheart is applied. With respect 
to AEEjDEEA and AEE^-j-j we did not know if any bias was to 
be expected. We assumed that AEErj.f was on average 5000 
(SD 1000) kj per 24 h and that the correlations between 
AEEref and AEEaco, AEErt3 or AEEiqeea, respectively, 
were 0-5. Thus we would be able to identify a 15 % bias in 
AEE with a power of 0-82 with twenty subjects. Therefore 
twenty healthy non-smoking, non-pregnant, non-lactating 
women were recruited by means of advertisements in the 
local press in Linkoping, Sweden, during the period 2007— 
2008. Data on their energjr metabolism have been reported 

1 (24,25) 

previously 

Activity energy expenditure assessed using reference methods 

CO2 production and O2 consumption were measured during 
a period of 20 min after an overnight fast and 45 min of 
rest using the Deltratrac Metabolic Monitor (Datex 



Instrumentarium Corp.), and converted to BMR' . Each 
woman was given an accurately weighed dose of stable iso- 
topes (0-09 g ^HzO and 0-23 g Hz'^O per kg body weight). 
Isotopic enrichments of dose and urine samples were analysed 
as previously described'-^^-'. Analytical precision for results in 
parts per million was 0-22 for H and 0-03 for O. Total 
body water was calculated as the average of H dilution 
space/1-04 and ^**0 dilution space/1-01. CO2 production 
was calculated assuming 30 % of water losses to be fractio- 
nated^^**'. TEE was calculated from CO2 production, assuming 
a food quotient of 0-85 . The ratio between H and 'O 
dilution spaces was 1-033 (sd 0-006) (« 20). When dose and 
urine samples from one subject were analysed nine times, 
the following CV were obtained: TEE (1-2 %), total body 
water (0-3 %) and fractional turnover rate constants (0-3 % 
or less), all well within the recommended criteria'-'^'^'. 
Reference AEE was TEEjj.f minus BMR (AEE^gf). Since the 
IDEEA was applied during 5 d only, TEEsdj^suit minus 
BMR was also calculated (AEEsj^esuit)- 

Actiheart 

Monitor. The Actiheart (CamNtech Ltd; http://www. 
camntech.com) consists of a uniaxial accelerometer, which 
records bodily movements and transfers this information 
into counts per min, and a heart rate recorder. The device 
delivers information regarding AEE based on the recorded 
information, subject-specific information (weight, height, age 
and sex) and on information obtained during calibration as 
described above and below. According to guidance provided 
by the manufacturer calibration was conducted with subjects 
in the fed state to provide estimates of AEE with DIT 
included (T. Evans, CamNtech Ltd, personal communication). 
This procedure was selected to obtain estimates of AEE 
comparable with those obtained by means of IDEEA and 
RT3 as mentioned above. The Actiheart is attached to the 
chest using electrocardiography pads (2660-3; 3M Svenska 
AB) connecting two electrodes to the device. Actiheart 
software (version 4.0.11; CamNtech Ltd) was used to initiate, 
transfer and analyse the recorded information. As 
recommended by the manufacturer, before analysing the 
recordings, the Actiheart software was used to clean and 
recover or interpolate noisy and missing heart rate data for 
gaps less than 5 min using a built-in algorithm (www. 
camntech.com). We also manually investigated the heart rate 
recording for gaps more than 5 min and found such gaps for 
fourteen women. However, these gaps were few and 
represented only 0-26 (sD 0-22) % of the total recorded time. 

Counts using Actiheart (CountSActJ ond heart rates. The 
number of recorded days were 14, 13, 12 and 9 for 
fourteen, two, two and two women, respectively. Recordings 
during these days covered 97 (sD 2) % of all time in the 
waking state. For each woman, counts assessed during all 
recorded days were summarised and divided by the number 
of recorded days to obtain Counts Acti (per 24 h). For each 
woman and for each minute during the recorded days, heart 



rate above resting heart rate (HRaR) was calculated as 
measured heart rate minus mean resting heart rate. 
Subsequently, all HRaR were summarised and divided by 
the number of recorded minutes to obtain mean HRaR 
(beats per min). Resting heart rate was the average heart rate 
recorded when measuring BMR. 

Calibration. AU women in the study participated in the 
following procedure. With the Actiheart attached to her 
body and a nose clip to her nose, the woman was connected 
to a spirometer (CPX/D; Spiropharma) through a 
mouthpiece. Her CO2 production and O2 consumption were 
measured every 15 s while heart rate and counts were 
recorded ever}' 1 min using Actiheart and while the woman 
simultaneously performed seven standardised activities 
(sitting, standing, walking at 3-2 km/h and 5-6 km/h, 
running at 8 km/h and cycling at 30 and 60 W) for 6 min 
each. Values recorded after 4 min were used for calculations. 
Energ}' expenditure was calculated using Weir's equation^"'^-'. 
In this way regression lines relating heart rate and counts, 
respectively, to energy expenditure were established for all 
women in the study. AU activities were used to establish 
regression lines for heart rate, while only resting (i.e. BMR), 
walking and running were used when such lines were 
based on counts, since the accelerometer in the 
Actiheart cannot distinguish between sitting, standing 
and cycling. For our twent}' women, the correlation 
coefficient for heart rate enetgy expenditure was 0-97 (SD 
0-02), while the corresponding value for counts was 0-97 (sD 
0-03). 

Calculation of activity energy expenditure assessed using 
Actiheart (AEEa^J. For each woman, heart rates and 
counts assessed during the recorded days were converted to 
AEE based on her particular regression lines and the 
appropriate subject-specific information using the branched 
equation for heart rates and counts in the Actiheart 
software. AEE when not wearing Actiheart was calculated 
using information in the notebook as BMR of the woman 
times a metabolic equivalent (MET) value, appropriate for 
each reported activit}''-'^^^ times the reported duration of each 
particular activitjr minus BMR of the woman during the 
corresponding period of time. The amount of energy thus 
obtained was added to AEE, calculated using the Actiheart 
software as described above. This value was divided by the 
number of recorded days to obtain AEEacb (in kj per 24 h). 
A corresponding calculation was conducted using data 
collected during the first 5 d of the 14 d period to obtain an 
AEE value comparable with AEEjdeea- 

IDEEA 

Monitor. The IDEEA device (Minisun LLC; http://www. 
minisun.com) consists of a microprocessor/storage unit, 
attached to the waist, and five sensors connected with wires 
to the microprocessor unit and attached to the front of the 
thighs, the soles of the feet and the sternum. The sensors 



send information regarding accelerations in two orthogonal 
directions and regarding angles of body parts to the 
microprocessor unit for identification of the following 
activities: lying down, reclining, transition, sitting, standing, 
walking, using stairs and running, and for recording the 
amount of time during which each activity is maintained. The 
device provides information, in counts per min, reflecting 
movements and positions of the body and combines the 
recorded information with subject-specific information 
(weight, height, age and sex) to calculate energjr expenditure '~' 
during all the time the woman wears the device. Initiation, 
calibration, recording and data analysis were conducted 
according to the manufacturer (http://www.minisun.com and 
M. Sun, MiniSun LLC, personal communication). Since the 
battery capacity of the IDEEA is only 48 h, the women were 
instructed to change batteries twice during the study period 
and all women managed to do so. The IDEEA memorjr 
capacity is limited, restricting the recording period to 5 
d. During our evaluation we compared AEEidi^j^a with 
AEEj^f, as 2 weeks is a more optimal metabolic period than 5 
d for the doubly labelled water method''"'"^ 

CountSiDEEA- Recordings were obtained during 3, 4 and 5 d 
for two, four and fourteen women, respectively, covering 98 
(SD 2) % of all time in the waking state during these days. 
For each woman, all counts assessed during the recorded 
days were summarised and divided by the number of such 
days to obtain CountSiDEEA (per 24 h). 

Calculation of activity energy expenditure assessed using 
IDEEA (AEEiqeea). For each woman, energy expenditure 
during all activities performed when the IDEEA was worn 
was summarised. Energ}' expenditure when not wearing the 
IDEEA was calculated, using information in the notebook, 
as the resting energy metabolism (see below) of the woman 
times a MET value, appropriate for each reported 
activity'-''^-*, times the reported duration of each activity. The 
amount of energy thus obtained was added to the energy 
expenditure assessed using the IDEEA as described above. 
In this way, TEE assessed by means of the IDEEA 
(TEEiD^iiiA) was obtained. TEEidii^a was divided by the 
number of recorded days to obtain TEEimiEA in kJ per 24 
h. AEEjDEEA (in kJ per 24 h) was calculated as TEEid^^iia 
minus an estimate of the resting energy expenditure. 
According to a recommendation by the manufacturer, 
average energjr expenditure when lying down during the 
recorded days was considered to represent the resting energy 
expenditure during these calculations (M. Sun, MiniSun 
LLC, personal communication). The equations used to 
predict energy expenditure by means of the IDEEA were 
found to be accurate for subjects in the fed state'-'^'' and 
thus we considered that AEEjdeea included DIT. 

RT3 

Monitor. The RT3 (Stayhealthy Inc.; http://www. 
stayhealthy.com), which records movements of the body in 



three axes, was attached to the right hip by means of a clip. 
The recorded information is delivered as counts per min 
and is transformed into AEE (in kj per 24 h) taking 
subject-specific information (weight, height, age and sex) 
into account. The software Stayhealthy RT3 Assist Version 
1.0.7 (Stayhealthy Inc.) was used to initiate the device and to 
process the recorded information. 

Counts ft j3. AH women wore the RT3 for 14 d, when the 
recordings covered 97 (sd 2) % of all time in the waking 
state. For each woman, all counts recorded during the 14 d 
period were summarised and divided by 14 to obtain 
CountSRT3 (per 24 h). 

Calculations of activity energy expenditure assessed using RT3 

(AEEffjj). For each woman, AEE during all the time when 
RT3 was worn was calculated by means of the software. 
Energ}' expenditure when not wearing the device was 
calculated using information in the notebook as BMR times 
a MET value, appropriate for each reported activity^'^^-*, 
times the reported duration of each particular activity' minus 
the BMR during the corresponding period of time. The 
amount of energy thus obtained was added to AEE, calculated 
using the software as described above. The value obtained 
was divided by 14 to obtain AEErts (in kJ per 24 h). 
A corresponding calculation was conducted using data 
collected during the first 5 d of the 14 d period to obtain an 
AEE value comparable with AEEjo^fiA. The equations used 
to predict AEE using the RT3 software were developed with 
subjects in the fed state (}. Collins, Stayhealthy Inc., personal 
communication). Therefore we considered that AEEr-j-^ 
included DIT. 

Evaluation of classification capacity 

This procedure evaluates the capacity' of a device to rank esti- 
mates of the women in the study and therefore provides an 
indication of the vaUdit}' of the monitor at the individual 
level. The procedure involves ranking women on the basis 
of, for example, their AEE^^f in a sequence. Thus, the 
woman with the lowest AEEjj.f had the lowest number and 
the difference in AEEj^f between this woman and the second 
in the sequence was the smallest possible. This principle of the 
smallest possible difference was maintained for all women, 
producing a sequence with gradually increasing AEE^^f. 
Then the women were divided into three groups with increas- 
ing AEEjj.f comprising six (lowest), seven (middle) and seven 
(highest) women, respectively. This ranking and grouping pro- 
cedure was carried out for AEEacu, AEErtj, AEEjdeea, 
AEEref, CountSAcd, CountSiDEiiA> CountSRT3 (all expressed 
as per 24 h) and for HRaR (beats/min). The classification 
capacit}' was then evaluated as the number of women placed 
in the same (0), in the next higher (+1) or lower (—1) and in 
the second next higher (+2) or lower (—2) group when com- 
pared with the groups obtained when classification was 
based on AEEj^f. 



Statistics 

AEE assessed using each of the different monitors was com- 
pared with AEEref using the procedure described by Bland & 
Altman'-^^''. According to this, the difference between AEE, 
obtained using a monitor (AEEaco; AEEr-j-s or AEEid^^iia), 
and AEEfj.f (j) was plotted against the average of the same 
two estimates {x) for all subjects. The mean difference and 
limits of agreement (+ 2 sd) were calculated. The mean differ- 
ence provides an estimate of the vaMdit}' of the monitor for 
groups, while the limits of agreement show this validity for 
individual subjects. Significant differences between mean 
values were identified using repeated-measures ANOVA 
with subsequent post hoc analysis using Tukey's multiple- 
comparison test. Pearson correlation and linear regression 
were also used. Variances obtained for AEEAcd, AEErxs or 
AEEiDEEA were compared using the / test for correlated vari- 
ables as described by Pitman'-^'-'. Significance was accepted at 
the P<0-05 level. Values are given as means and standard 
deviations. All statistical analyses were conducted using 
Statistica software, version 8.0 (Statsoft; Scandinavia AB). 

Results 

Won)en and energy expenditure results 

Characteristics of the women are shown in Table 1 . AEEjj.f, in 
kJ per 24 h, was not significantly correlated with body weight 
(rO-33; P= 0-16). Table 2 shows AEE^ef and AEEsdresuh- On 
average, AEE^j^jj^it was 2 % higher than AEE^^f and the SD 
values of these two estimates were quite similar. 

Bland-Altman evaluations 

Fig. 1 shows Bland-Altman plots for AEEacu (a), AEEideea 
(b) and AEEr-j-j (c). The mean differences, in kJ per 24 h, p. 
AEE„f were 740 (Actiheart), -1750 (IDEEA) and -2010 
(RT3). The limits of agreement (in kJ per 24 h) were wide 
for aU monitors, i.e. 2940 (Actiheart), 2650 (IDEEA) 
and 1820 (RT3). The mean differences for results were: 
AEEActi - AEE,rf: 11-5 (sd 25-2) kJ per 24 h per kg; 
AEEiDEEA - AEE,^f: -26-5 (sd 23-0) kJ per 24 h per kg; 



Table 1. Characteristics of the twenty women in the study 
(IVlean values, standard deviations and ranges) 





IVlean 


SD 


Range 


Age (years) 


36 


8 


22^5 


Body weight (kg) 


67-3 


13-9 


47- 1-1 01 -6 


Height (m) 


1-69 


006 


1-55-1 -81 


BIVII (l<g/m^)* 


23-4 


4-1 


17-7-33-6 


TEEref (kJ per 24 h) 


10 930 


1410 


8120-13 120 


TEEsdresuit (kJ per 24 h) 


11 060 


1400 


8350-12 810 


BIVIR (l<J per 24 h) 


5920 


740 


4920-7650 


PAL,e, 


1-85 


0-13 


1 ■65-2- 11 



TEEfef, total energy expenditure measured using the doubly labelled water method 
during days 1-15; TEEsdresuit, total energy expenditure measured using the doubly 
labelled water method during days 1-5; BMR, BMR measured using indirect calori- 
metry; PAL,e,, physical activity level calculated as TEE,ef divided by BMR. 
* Three women (15 %) were overa/eight (BMI 25-29-9 kg/m^), while two women 
(10 %) were obese (BMI > 30 kg/m^). 



Table 2. Activity energy expenditure (AEE) assessed by means of the Actiheart, IDEEA and RT3 as well as by means of reference methods (n 20) 
(Mean values and standard deviations) 



AEE (kJ per 24 h) AEE (kj per 24 h per kg) 





Mean 


SD 


Mean 


SD 


AEEAoii 


5760 


1380 


88 


25 


AEEiDEEA 


3270*t 


1180 


50*t 


20 


AEErt3 


301 0*t 


810 


46*t 


13 


AEE,e, 


5020 


890 


76 


15 


AEEsdresult 


5140 


920 


78 


17 



AEEaca, AEE obtained by means of the Actiheart; AEEideea. AEE obtained by means of the Intelligent Device for Energy Expenditure and Physical Activity (IDEEA); AEErts, AEE 
obtained by means of the RT3; AEE,ef, total energy expenditure measured using the doubly labelled water method during days 1-15 minus BMR measured using indirect calori- 
metry; AEE5j,esuit. total energy expenditure, measured using the doubly labelled water method during days 1-5 minus BMR measured using indirect calorimetry. 
* Mean value was significantly different from that for AEE,of (P < 0 001). 
t Mean value was significantly different from that for AEEst^esuit (P< 0 001 ). 



and AEErts - AEE.^f: -30-5 (so 15-2) kJ per 24 h per kg. No 
significant linear relationships could be identified when the 
difference between estimates obtained using any of the moni- 
tors and the corresponding reference estimate was regressed 
on the average of the same two estimates. This was true 
when results were expressed in kJ per 24 h as well as in kJ 
per 24 h per kg. As a consequence of these results, the follow- 
ing evaluations were considered necessary. 

Comparison of means 

A statistical comparison of AEE^^j-t;, AEEjdeea and AEEr-j-^ p. 
AEEf(.f is shown in Table 2. When expressed in kJ per 24 h, 
average AEEach was 14-7 % higher than average AEE^ef, but 
the difference was not statistically significant. AEEri-3 and 
AEEideea underestimated (P< 0-001) AEE^^ by 40 and 35 
%, respectively. Furthermore, as also shown in Table 2, similar 
results were obtained when AEE was expressed per kg body 
weight (kJ per 24 h per kg). 

Correlations 

When AEEref was correlated with AEEacb, AEEio^ea or 
AEEri-3 no significant relationships were obtained, neither 
for values expressed in kJ per 24 h, nor for values expressed 
in kJ per 24 h per kg. Furthermore, AEEjoe^a - AEEj5.f, 



AEErt3 - AEE^ef and AEEach - AEE^jf, in kJ per 24 h or 
in kJ per 24 h per kg, were not correlated with each other. 

Comparison of variances 

The variance for AEEr-j-^ was significandy lower than that for 
AEEach when values were expressed in kJ per 24 h (P = 
0-006) or in kJ per 24 h per kg (P< 0-001). The variance of 
AEEiD£i£iA was not significandy different from the variances 
of AEErts or AEEacb when values obtained during 5 d 
were compared. 

Classification capacity 

Fig. 2 shows the capacity' of the Actiheart, the IDEEA and the 
RT3 to classify estimates of AEE when compared with 
AEEref. The Actiheart and the IDEEA both classified only 
six women (30 %) correcdy while the corresponding figure 
for RT3 was twelve (60 %). Correspondingly, when classifi- 
cation was based on CountSRX3 fourteen women (70 %) 
were correcdy classified while CountSiDEEA or CountSAod 
classified only six women (30 %) correctly. When classification 
was based on mean HRaR, six women (30 %) were correcdy 
classified. Similar classification capacity' results were obtained 
when AEErj.f, AEEacq, AEEj^^^iia and AEErts were 
expressed in kJ per 24 h per kg (data not shown). 
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Fig. 1. Bland-Altman plots comparing activity energy expenditure (AEE) assessed using monitors v. reference estimates, (a) AEE obtained using the Actiheart 
(AEEaob) v. AEE measured using a combination of the doubly labelled water method and indirect calorimetry (AEEref). AEEaou - AEEret was 740 kJ per 24 h 
(2 SD 2940). The regression equation was y=0 68x- 2923; rO-42 (P>0 05). (b) AEE obtained using the IDEEA (AEEideea) AEE,ef. AEE^eea - AEE,ef was - 
1750 kJ per 24 h (2 sd 2650). The regression equation was y=0 46x- 3645; r 0 28 (P>0 05). (c) AEE obtained using the RT3 (AEErts) v. AEEref. AEErts - 
AEEref was -2010 kJ per 24 h (2 sd 1820). The regression equation was y=-0■^4x- 1462; rO H (P>0 05). 
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Fig. 2. Capacity of activity monitors to classify activity energy expenditure 
(AEE). Number of women classified in the same (0), in the next higher (+1) 
or lower (-1), in the second next higher (+2) or lower (-2) group as compared 
with groups obtained when the classification was based on AEE assessed 
using a combination of the doubly labelled water method and indirect calorime- 
try (AEEref). (a) AEE obtained using the Actiheart (AEEActi)- (b) AEE obtained 
using the IDEEA (AEEioeea)- (c) AEE obtained using the RT3 (AEErts). 

Discussion 

As indicated above, estimates of AEE are often corrected by 
deducting a value for DIT equal to 10 % of TEE. 
However, this is based on studies showing that DIT varies 
between 5 and 15 % of TEE'^*^ and therefore AEE values 
with this correction cannot be considered to represent accurate 



estimates of AEE. On the other hand, for example, although 
our estimates of AEEActi include some DIT since calibrations 
were conducted with subjects in the fed state, it cannot be sta- 
ted with assurance that the amount of DIT included is an 
accurate estimate of DIT during 24 h. Thus AEE assessed 
by monitors is never quite comparable with AEE assessed 
using reference methods. However, for the reasons provided 
in the paragraph below, we do not consider that this problem 
has affected the validity of the present results. 

We calculated AEE as TEE - BMR with no correction for 
DIT since this was the most appropriate way to compare 
results obtained by the three monitors. An alternative possi- 
bility, however, is to base the comparison on PAL values. 
Since PAL is calculated as TEE/BMR it provides an estimate 
of physical activity that is independent of body weight. Body 
weight is associated with TEE and thus with the magnitude 
of DIT as well as with BMR. Since PAL is less affected 
than AEE by variations in DIT, PAL values are commonly 
calculated without any correction for DIT. We provide results 
for PAL assessed using the Actiheart, the RT3 and the 
IDEEA V. PALjef in supplementarjr material (online 
Supplementary Tables SI, online Supplementary Table S2; 
and online Supplementary Fig. SI). These two tables, SI and 
S2, and Fig. SI show that the present results are similar and 
our conclusions identical when using PAL rather than AEE. 
Therefore we consider that our findings regarding the capacity' 
of the three monitors to assess energ}' expenditure in response 
to physical activitjr represent valid results. 

AU twentjr women carried the RT3 during the complete 14 d 
period while fourteen women carried Actiheart and IDEEA, 
for 14 and 5 complete days, respectively. The present results 
and conclusions were the same when calculations were 
based on these women only. 

In our women, average AEEActi was nearly 15 % higher 
than average AEE^^f and this difference was not significant. 
This raises the question if the present study was too small 
to identify a significant overestimation in AEE by the 
Actiheart. As mentioned above, we expected Actiheart to pro- 
duce average estimates of AEE in agreement with reference 
values since the calculations are based on a calibration pro- 
cedure. Heart rate recording is an important component of 
this procedure and Westerterp'*"' compiled results from eleven 
different studies and concluded that none of them identified 
any significant difference at the group level between TEE 
assessed by means of heart rate recording v. doubly labelled 
water. Validation studies of Actiheart using reference methods 
in Cameroon adults^^ ''', in US children'-'^'^'' and in French adult 
men*-^'' or using a combination of a heart rate recorder and an 
accelerometer^'^'''^^'' indicate that, when compared with cri- 
terion methods at the group level, such estimates of AEE pro- 
duce non- significant overestimates''^'' ranging from +0T to 
+26-8 % or non-significant underestimates''' '^'"^'^ ranging from 
—7-9 to —9-1 %. It should be noted, however, that these 
results''''^''^'''''''' may not be quite comparable since there are 
minor variations in experimental conditions regarding how 
reference AEE is calculated, how Actiheart is applied to assess 
energy expenditure, and how the recorded information is used 
to calculate AEE. Nevertheless, the facts above provide 



substantial evidence for the statement that Actiheart is able to 
assess the average AEE of groups and our findings can be 
reconciled with this statement. This is important considering 
the need for methods to accurately assess the average energy 
expenditure of groups when evaluating the vaUdit}' of dietary 
intake data'"'^-*. For such validation simpler methods, such 
as physical activity questionnaires, may be considered. 
However, such methods often have poor criterion validity at 
the group level'-'^' and may be influenced by subjective factors. 
Therefore, although far from perfect, the Actiheart must stiU 
be regarded as superior to questionnaires for this application. 

("15 '^1 3S1 

Contrary to previous findings ' , AEEacu and AEE^^f 
were not correlated in the present study, possibly because 
our population covered a more narrow range of AEE than 
was done by previous studies''''^'^'''^'^^ The limits of agreement 
for AEEach were wide in the present study with 2 SD being 
equivalent to 50 "/o of AEE^^f. The present results for 
AEEacb — AEEfj.f in kj per 24 h can be compared with the 
corresponding results, 4 (sd 824) kJ per 24 h, as reported by 
Butte et aiy^\ Their sd value, 824, is equivalent to about 32 
% of average reference AEE of the subjects in their 
study^'^'''' while the corresponding value for our subjects is 
about 29 %. The present results for AEEacu — AEE^^f 
(mean 11-5 (sD 25-2) kJ per 24 h per kg) can be compared 
with the corresponding results by Assah et al^^^ (mean —5-4 
(sd 29-0) kJ per 24 h per kg) and by ViUars et alp-^^ (mean - 
4-6 (sd 13-1) kJ per 24 h per kg). Villars et alP''^'^ found the 
capacit}' of Actiheart to assess AEE at the individual level to 
be better than that observed in either the present study or in 
the study by Assah et al^^^^ . Again, variations in experimental 
conditions may be responsible for these discrepancies. Thus, 
in the study by Assah et alF^^^ calibration was conducted 
using the so-called step-test rather than the individual calibra- 
tions that we used and which Villars et alP'^^ found to produce 
the most accurate results. The studies by Assah et alS^"^^ and by 
Villars et alP'^^ recorded data throughout 24 h periods, while 
our subjects did not carry Actiheart during sleep. The latter 
discrepancy is not likely to be important, however, since 
AEE during sleep is close to zero. Regarding the different 
results found in the present study and in the study by Villars 
et alP'^\ it may be relevant that the equations in the 
Actiheart software were, as far as we have been able to assess, 
primarily developed in men'^^'^'''' and may have been inap- 
propriate for our women. Brage et al}-^^''^ reported higher 
noise rates in women than in men when using Actiheart, 
suggesting that this sex difference is due to signal attenuation 
caused by more subcutaneous fat in women than in men. 
Additional work may be needed to make the Actiheart pro- 
cedure more suitable for women. 

The present results show that the IDEEA device underesti- 
mated AEE by approximately 35 %. This result is based on a 
comparison with AEE^^f. Comparing average AEEjd]^[ia with 
average AEEj^jj-^syit produced very similar results. A Bland— 
Altman evaluation similar to that shown in Fig. 1(b), but 
based on AEE5ar(.suit rather than on AJSL^^f, showed wider 
limits of agreement, 2 SD being 3027 rather than 2650 kJ per 
24 h. An important explanation for this observed increase 
may be the imprecision in AEEsj^^syit. Our observation that 



the IDEEA underestimated AEE is in contrast to a previous 
evaluation of a similar device by Whybrow et alp'^^^ who 
reported an overestimation of AEE by 48 %. Furthermore, 
the limits of agreement obtained in the Bland— Altman evalu- 
ation of AEE were smaller in the present study where + 2 sd 
ranged between -A-A and 0-9 MJ per 24 h. The corresponding 
range in the study by Whybrow et al}-'^^^ was from -2-7 to 4-5 
MJ per 24 h. However, it is difficult to compare their evaluation 
with ours since they used a modified version of the IDEEA 
with eight sensors instead of five. Furthermore, their protocol 
was different and we do not know to what extent their calcu- 
lations were different from ours. One obvious explanation for 
the underestimation of AEE by means of the IDEEA in the 
present study is the use of energy expenditure when lying 
down as an estimate of resting energy metabolism as rec- 
ommended by the manufacturer. Using our measured BMR 
to calculate AEEid^i^ia reduced the underestimation to 1 "/o. 
However, when we calculated AEEideea in this way, neither 
the correlation with AEE^^f nor the classification capacity was 
improved. Several reports show that the IDEEA can classif}r 
activities accurately'^'^^' and therefore the poor results are 
probably due to errors introduced when calculating energy 
expenditure. Unfortunately, the details regarding this calculation 
are unknown to us, making it difficult to suggest explanations 
for our observations. However, a possible explanation for the 
inaccuracy at the individual level may be that IDEEA uses 
MET values to calculate energ}' expenditure and such values 
are known to vary between individuals''^''. It may also be rel- 
evant to note that energjr expenditure due to fidgeting is unlikely 
to be included in the IDEEA estimates Levine et al}^"'^ 
reported that energj' expenditure during sitting and standing 
while fidgeting could be 46 % and 69 % higher than when sit- 
ting and standing motionless, respectively. We conclude that the 
IDEEA results showed wide limits of agreement indicating 
poor accuracy at the individual level. 

Average AEErts was 40 "/o lower than average AEE,j.f, and 
the RT3 underestimated AEE in all women except one. Three 
studies have evaluated the RT3 against reference 
methods'''^''^''*'''' and all showed lower average AEE values 
V. average reference AEE, i.e. —15 "/o^'^'-*, —17 "/o''^^ and 
—33 "/o^^''. Regarding results at the individual level, our findings 
are in agreement with data for lean men as reported by ViUar 
et aiy^^ who found that the SD of the difference between 
AEE^ef and AEErts varied between 14-2 and 17-7 when results 
were expressed in kJ per 24 h per kg. The corresponding figure 
in the present study was 15-2 kJ per 24 h per kg. Other relevant 
findings were presented by Westerterp and colleagues'-'^-', who 
have validated different versions of a three-axial accelerometer, 
Tracmor, for more than a decade. Acceleration measured using 
Tracmor was found to explain the largest variation in TEE 
when compared with other accelerometers'-'^''*'-'. In recent pub- 
lications, average PAL, assessed by means of Tracmor, was 
shown to agree with PAL measured using reference methods'-'*'''' 
and average AEE, assessed by means of the three-axial acceler- 
ometer GENEA, was in good agreement -with reference 
AEE'-'^'. Thus, the problem with underestimation possibly 
associated with multiaxial accelerometr^' may be overcome, 
but more studies are needed to confirm this. 



Although the RT3 was found to underestimate average 
AEEr(.f, its performance at the individual level was good in 
comparison with the Actiheart. Thanks to the design of the pre- 
sent study where the monitors were evaluated in the same 
women, we were able to demonstrate that the RT3 was superior 
to the Actiheart regarding its ability to provide relevant estimates 
of AEE for individuals. Bonomi et iz/'-^''-' showed that Tracmor 
also is very satisfactory at the individual level. Furthermore, it 
should be noted that the RT3 is a verjr user-friendly device 
since it does not require calibration procedures demanding 
extra resources. Some of our women complained that the elec- 
trodes needed to attach Actiheart caused itching. An advantage 
with RT3 is certainly that it does not require any such electro- 
des. Furthermore, good results can apparentiy be obtained at 
the individual level by means of RT3 even if subjects only 
wear the monitors during the dajrtime, which is a considerable 
advantage from a practical point of view. 

In the present study we used equations provided by the man- 
ufacturers to calculate AEE from raw output data (i.e. heart rate 
and counts). However, when classification capacit}' was calcu- 
lated using either raw output data or the corresponding AEE 
values, similar results were obtained. Obviously, the equations 
used did not change the interindividual variation in the investi- 
gated variable as assessed by any of the three devices. 

A strength of the present study is that we measured TEE 
and BMR using methods with high accuracy and precision 
whUe a limitation is the small sample size, which limits gener- 
alisabiEt}'. Furthermore, the present results are limited to 
women of reproductive age. However, our women covered a 
wide range of BMI values and their average PAL was similar 
to that of European and American women aged 20—45 
years^^^'. Furthermore, the range in PAL values observed for 
our women (1-65— 2-11) covers such values for many 
Western women'***'. Thus the present results are likely to be rel- 
evant for many subjects in the Western world. However, this 
does not mean that the present results are necessarily applicable 
in such populations since many subjects, also in the Western 
world, may have a different pattern of physical activit}'. 

The present results and the discussion above demonstrate 
the complexity involved when assessing human physical 
activity. Obviously, evaluations at the group as well as at the 
individual level are required to assess the fuU potential of 
any procedure intended to assess energy expended in response 
to physical activity during free-living conditions. The three 
devices studied in the present paper have strengths and weak- 
nesses and are therefore likely to be useful in different situ- 
ations. Thus, Actiheart may well be useful when the average 
AEE of a population is of interest, for example when validat- 
ing assessments of energy intake for a group of subjects. 
However, the inaccuracy at the individual level is a concern. 
In studies where differences between individuals are of inter- 
est, for example, when physical activity is linked to the risk 
for a disease, a multiaxial accelerometer may be preferable. 
Furthermore, when evaluating different devices it is important 
to consider the physical activity of the study population. It is 
much easier to identify differences in physical activity' between 
individuals in a population with a large variation in physical 
activity. However, in studies of the health effects of physical 



activit}', rather small differences between individuals may be 
of interest. We recommend that any method for assessing phys- 
ical activity should be evaluated in a population comparable with 
that in which it is to be applied, and furthermore that the evalu- 
ation procedure should be appropriate for the specific research 
question of the study. If there is a choice between methods, it 
may be advantageous if each method can be tested in represen- 
tative subjects before starting the main study. 

We evaluated the capacit}' of three devices to assess AEE at 
the group and at the individual level. The study was conducted 
in one group of women, which contributed to revealing the 
strengths and weaknesses of the devices. The results can be 
reconciled with previous results indicating that Actiheart has 
the capacity to assess the physical activitjr of groups although 
its inaccuracy at the individual level is a concern. The present 
results demonstrated limitations of the IDEEA system, and 
the potential of the three-axial accelerometer RT3 to study 
physical activitjr of individuals. Our findings highlight the 
need to apply appropriate procedures when studying inter- 
actions between physical activity, energy intake and health. 
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